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DETAILED ACTION 

The Group and/or Art Unit location of your application in 
the PTO has changed. To aid in correlating any papers for this 
application, all further correspondence regarding this 
application should be directed to Group Art Unit 2165. 

Response to Arguments 

1. Applicant's arguments filed 1/5/07 have been fully 
considered but they are not persuasive. 

{A} In re page applicant states, that the combination of Aotake 
and Morimoto does not describe marking user or private data 
fields of scene change frames. 

In response the examiner has reviewed all arguments, the 
rejection is a 103 Aotake in view of Morimoto. 

Morimoto does teach/disclose in the background, in MPEG 
there is an area set aside for additional information, being an 
MPEG user data field (col. 1 lines 44-53), wherein some 
additional information is put into the MPEG video bit stream, 
thereby hiding additional information into a user data field ha 
been employed, wherein this area detection and removal are easy 
being an advantage to later detection and use, as is obvious . 

The claims as amended, further recite, "wherein the user o 
private data fields are stored separately from the encoded 
content within the frames " . 

This newly recited passage reads directly on MPEG user dat 
fields which are: set aside for hiding, embedding additional 
information, since known to store additional information the 
examiner renders it : obvious to store scene change bit/bits to 
indicate scene changes, being obvious to a separate index for 
the same . 

The examiner relies in the teaching within Morimoto in the 
background, which these user areas, read on the claims as 
amended, these fields are set aside user areas for additional 
information for that purpose, have no affect -in picture quality 

The examiner relies on the teaching of Morimoto, col. 1 
line 55- , -the . teaching in the background, 
being col. 1, lines 1 44-53. 
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In response to applicant's argument that there is no 
suggestion to combine the references, the examiner recognizes 
that obviousness can only be established by combining or 
modifying the teachings of the prior art to produce the claimed 
invention where there is some teaching, suggestion, or 
motivation to do so found either in the references themselves or 
in the knowledge generally available to one of ordinary skill in 
the art. See In re Fine, 837 F.2d 1071, 5 USPQ2d 1596 (Fed. 
Cir. 1988) and In re Jones, 958 F.2d 347, 21 USPQ2d 1941 (Fed. 
Cir. 1992) . 

The examiner deems the combination obvious, to utilize , user 
data areas of MPEG, to store/carry/embed/hide, such information 
as scene change information, generated by Aotake, as an obvious 
alternative to a separate index, wherein the embedded 
information can be easily removed, upon decoding the MPEG video 
stream. - t 

Claim Rejections - 35 USC § 103 

1. The following is a quotation of 35 U.S.C. 103(a) which forms 
the basis for all obviousness rejections set forth in this 
Office action: 

(a) A patent may not be obtained though the invention is 
v not^ identically disclosed or described as set forth in 

section 102 of this title, if the differences between the 
subject matter sought to be patented and the prior art are 
* such that the subject matter as a whole would have been 
obvious at-the time the invention was made to a person 

- having* ordinary skill in the art to which said subject' 
matter pertains. Patentability shall not be negatived by 
the manner in which the invention was made. 

This application currently names joint inventors. In 
considering patentability of the claims under 35 
U.-S . C. 103 (a)-, the examiner presumes that the subject 
• matter of the various claims was commonly owned at the' time 
any -inventions covered therein were made absent any 
evidence to the contrary. Applicant is advised of the* 
obligation under 37 CFR 1.56 to point out the inventor and 
invention dates of each claim that was not commonly owned 
at the time a later invention was made in order for the 
examiner to consider the applicability of 35 U.S.C. 103(c) 

- and potential 35 U.S.C. 102(f) or (g) prior art under 35 
U.S.C.: 103 (a) ; 
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2. Claim 1-3, 6-14 and 16-18, 21-29, 31-33 and 36-44 are rejected 
under 35 U.S.C. 103(a) as being unpatentable over Aotake (US 
6,411,771) in view of Morimoto et al . (US 6,005,643). 

Regarding claims 1, 2-3, 6-7, Aotake discloses and meets 
the limitations associated with a computer for processing a 
video stream received, the apparatus and associated method 
comprising the steps of: 

• receiving a video stream, wherein the video stream 
comprises multiple frames (Fig. 6 a, col. 20); 

• analyzing the video stream to ID scene changes between 
frames and an encoder (col. 20, "evaluation of a picture 
subjected to encoding by referencing the frame memory unit 
110", "amount of information" or "amount of code as a 
result- of encoding") ; 

• marking with respect to the field or frames of the video 
stream (col. 4) and wherein the encoder is a compression 
encoder which compresses a stream into a file. on the 
computer, claim 10. 

Regarding claims 1, 3, 7, Aotake, creates an index for the 
purpose of extracting and displaying or to provide an index of 
access .points fqr displaying specific scenes or segments Figs. 

15, 21 etc ...... • , 

to identify scenes change point within a video stream, 

• but, fails to disclose marking fields of frames of a video 
and therefore, fails to clearly disclose updating at least 
a data bit in a field of a video frame, to indicate a scene 
change and' wherein the user or private fields are stored 
separately from the encoded content with in the frames. 

Morimoto, discloses teachings in the art, see, 

"Background of the Invention", at col. 1, LINES 44-54, 

"MPEG is well known ... some additional information is put 
into an MPEG video bit-stream, a method of hiding additional 
information into a user data field . Therefore updating at 
least one bit, of a video frame (I, P, B types frames of ( an 
MPEG "Video stream) , area/field being a USER DATA field/area, 
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has generally been employed for storing additional 
information. Which meets the limitation of as claimed, us'er or 
private data field/fields, to store additional information, of 
an MPEG compressed video stream of frames (I, P and B type 
frames) . 

The user data fields/areas, are within the frames, but, 
separate from the content (video) , being an MPEG layer 
fields/areas, intended for holding/storing/carrying additional 
information, allowing for easy removal (col. 1, lines 50-52) . 

Morimoto describes that this type of embedding may be 
easily separated from the media, which to Morimoto is a 
problem that the detection and removal are easy and his 
invention, improves embedding to alleviate this issue (see 
below) . 

Therefore, it, would have been obvious to one skilled in the 
art at the time of the invention to modify Aotake by 
incorporating marking fields/areas of an MPEG stream at the 
encoder, meeting the limitation of user or private type data 
fields -of a frame thereby updating the stream with at least one 
marker bit, being a location to store additional data which is 
separate -from the 1 encoded content with the frames, as taught by 
Morimoto^' as described in the background, which using these 
areas, user data areas causes no degradation or to be in a 
manner transparent, when rendering video, as is obvious to those 
skilled -in- the art> which is deemed an obvious alternative to a 
separate index file, with respect to the video, to mark in 
user/private field- of a video frame, to indicate scene changes, 
to later thereby, detect and render, for the purpose of 
identification of scene change point In an editing system for 
intended editing purposes, as taught by Aotake in view of the 
teachings of Morimoto. 

Claim 8, have been analyzed and discussed with respect * to 
the claims above. 

Regarding claim 9, Aotake discloses indicating the amount a 
scene has • changed in relation to the corresponding scene change 
point indexed, as -taught by Aotake. 

It would- have- been obvious since Aotake generates the 
additional data for scene changes, wherein Morimoto teaches * 
embedding various additional information being different 
messages, as suggested by Morimoto, therefore, it would have 
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been obvious to those skilled in the art at the time of the. 
invention to utilize and embed additional data bits, as 
suggested by the combination of Morimoto and Aotake, to embed 
the generated data of Aotake in a field, as taught Morimoto 
representing additional bits generated by Aotake and/or to embed 
at least some additional data in to the field or more than one 
bit data, as is obvious to those skilled in the art with these 
references in front of themselves. 

Regarding claims 11-12, Aotake disclose and meets the 
limitation of wherein a frame of the video file representing a 
scene change comprises a full frame, Figs. 21 & 24 rendered of 
or displayed full frames and a DELTA (being a frame with large 
changes, represented by a high threshold, see Aotake (Fig. 19) . 

Claim 13 is analyzed and discussed with respect to claim 9, 
further rendering obvious to scan the fields having amount of 
scene change attribute added thereto and to provide an 
extraction tool to select frame exceeding an amount of scene 
change (Aotake, cols. 45-46 and Fig. 19, "exceeding a 
predetermined threshold value be displayed on the source window 
362. -The'-threshold value is entered by the user"), as is deemed 
obvious to those skilled in the art. 

Regarding claim 14, disclose at col. 10, that either the 
encoder and decoders can b either software or hardware, but; the 
combination fails particularly mention wherein the extraction 
tool access the scene change data in the fields in real time. 

Aotake: discloses that hardware can be used (col. 10), 
wherein the examiner takes official notice that, hardware is 
obviously -capable of processing at higher levels, than software, 
such as real time video processing, therefore, it would have 
been obvious- to those skilled in the art, to playback at in. real 
time or the normal playback speed with respect to the video 
standard and detect additional field data in real time, as is 
obvious to those skilled in the art. 

- Claims- 16-18-, 21-29 and 31-33 and 36-44 have been analyzed 
and discussed- with respect to the claims above, but, claims 31- 
44 represent an article of manufacture, deemed met by the 
combination with Aotake col. 49, having a program to let a 
computer -process, -therefore an article of manufacture or a 
computer program to facilitate the method with a computer being 
the hardware . 
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3. Claims 15, 30 and 45 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Aotake (US 6,411,771) and Morimoto et 
al. (US 6,005,643) and further in view of Tonomura et al / (US 
6,571, 054) . 

Regarding claims 15, 3 0 and 45, the combination as applied 
fails to disclose generating a storybook with the extracted 
frames . 

Tonomura teaches at col. 3, "automatically creates a book like 
electronic book by a procedure of analyzing a video sequence to 
detect various events such as a scene change" and col. 10, lines 
58-, "Items that can be placed in page are every kind of data 
that can be managed by a computer, such as text, images, 
representing images linked to a video and sound data. All the 
items that are carried on the electronic image book are items 
numbers for identification ... as taught by Tonomura. 

Therefore, it would have been obvious to one skilled in the 
art at the time of the invention to modify the combination by 
utilizing the scene change frames and creating automatically 
creating an electronic image book, wherein the book can have 
text, therefore, a story book with extracted scene change 
images, as taught by Tonomura. 

Conclusion 

2. Applicant's amendment necessitated the new ground(s) of 
rejection presented in this Office action. Accordingly, THIS 
ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is 
reminded of the extension of time policy as set forth in 37 
CFR 1.136 (a) . 

. A shortened statutory period for reply to this final action 
is set to expire THREE MONTHS from the mailing date of this 
action. In the event a first reply is filed within TWO MONTHS 
of the mailing date of this final action and the advisory action 
is not mailed until after the end of the THREE-MONTH shortened 
statutory period, then the shortened statutory period will 
expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated 
from- the mailing date -of the advisory action. In no event, 
however, will • the statutory period for reply expire later than 
SIX MONTHS from the: date of this final action. 
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Any inquiry concerning this communication or earlier 
communications should be directed to the examiner of record 
Vincent F. Boccio whose telephone number is (571) 272-7373. 

The examiner can normally be reached on between Monday thru 
Friday between (7:30 am to 5:00 pm) . 

If attempts to reach the examiner by telephone are 
unsuccessful, the examiner 1 s supervisor, Jeffrey Gaff in can be 
reached on (571) 272-4146. 

The fax phone number for the organization where this 
application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be 
obtained from the Patent Application Information Retrieval 
(PAIR), system. Status information for published applications may 
be obtained. from either Private PAIR or Public PAIR. 

Status information for unpublished applications is 
available through Private PAIR only. 

For more information about the PAIR system, see 
http://pair-direct.uspto.gov. Should you have questions on 
access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free) . 

If you- would like assistance from a USPTO Customer Service 
Representative or -access to the automated information system, 
call- 800-786-9199 (IN ^USA OR CANADA) or 571-272-1000. 
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